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(54) Method and system for monitoring and enhancing computer-assisted performance 



(57) A system and method is provided for monitoring 
and enhancing computer assisted performance at a us- 
er interface for a business terminal. The method in- 
cludes measuring (62) the performance of the user in- 
teraction with the user interface, adjusting (64) param- 
eters of the user interface to try to increase the perform- 
ance of the user interaction, tracking whether the per- 
formance has increased, and causing (66) an escalation 
event to occur if the user performance is below a pre- 
determined level. The system and method preferably in- 
cludes creating a user profile of the parameters that ob- 
tain the best performance for each user. This user profile 
may be created during new employee orientation but is 
updated continually as the user uses the business ter- 
minal to complete actual business transactions. 
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Description 

[0001] The present invention relates to a method and 
system for monitoring and enhancing computer-assist- 
ed performance, particularly in a business terminal, 
such as a retail point-of-sale terminal or a financial au- 
tomated teller machine (ATM). 
[0002] Many businesses rely on their employees in- 
teracting with computerized business terminals, such as 
point-of-sale terminals or inventory control terminals, to 
complete transactions with customers. The computer- 
ized business terminals often have customized applica- 
tions and user interfaces which vary from business to 
business. The workers often are not very knowledgea- 
ble about the computer systems in general and particu- 
larly a business' customized applications and interfac- 
es. 

[0003] For example, at Christmas time, retail outlets 
typically hire temporary customer service representa- 
tives, clerks or other workers to handle increased busi- 
ness. These temporary workers are often not familiar 
with the work to be performed and additionally are not 
familiar with the customized computer-based systems 
of the business, such as the point-of-sale equipment. 
Training of these temporary workers is expensive and 
time-consuming. Many times the temporary workers on- 
ly receive between two and eight hours of training, and 
the training occurs remote from the actual floor or serv- 
ice area where the worker will be stationed. After this 
meager training, the temporary workers are stationed 
"on the floor" and expected to provide high quality serv- 
ice to the customer. The temporary workers can easily 
become frustrated and high turnover may result. 
[0004] Similarly, customers of banks or other financial 
institutions are expected to interact with financial auto- 
mated teller machines (ATMs) with little or no training. 
Some customers have little previous experience with 
the computer-based systems and do not find the inter- 
faces very user-friendly. These customers may avoid 
using the ATMs and instead require the financial insti- 
tution to provide services via a live teller, increasing 
costs. 

[0005] Computer-assisted learning systems used as 
educational tools to help students with traditional learn- 
ing activities are known. These learning systems often 
provide feedback to help a student learn, based on input 
from the student. These systems may even adjust the 
presentation of material to help the student learn if built- 
in testing indicates that the student has not mastered 
the desired concept. However, these systems are de- 
signed to teach new concepts to a certain level of ex- 
pertise and then move on to other new concepts rather 
than to increase proficiency with standard, customized 
interfaces in a business environment. 
[0006] It is also known to provide varying levels of in- 
formation to users based on their skill level with a par- 
ticular system such as a word processing system. How- 
ever, the varying levels of information are provided in 



discrete levels such as for beginning or advanced users 
so that all parameters of the interface are adjusted 
based on the discrete level assigned to the user. 
[0007] It is also known to provide simulated work 

5 problems on a computer-based system, but these sys- 
tems are designed to train workers who will be using the 
system for a relatively long period of time and will grad- 
ually master different aspects of the system over the pe- 
riod of work. Since these systems are not provided while 

10 a worker is performing actual work or a customer is per- 
forming an actual financial transaction at an ATM, they 
do not help a new worker quickly succeed in the on-the- 
job work environment or the customer succeed with the 
generally cheaper-to-operate ATM. Therefore, whenev- 

15 er a new worker or a new customer is required to interact 
with the system, training expense and loss of productiv- 
ity or efficiency occurs. 

[0008] It is the object of the invention to provide a 
method and apparatus for monitoring and enhancing 
20 computer assisted performance, particularly in interac- 
tions with a business terminal, such as a retail point-of- 
sale terminal or an ATM. 

[0009] According to the invention a method for moni- 
toring and enhancing computer-assisted performance 
25 with a business terminal having a user interface with in- 
dependently adjustable parameters, comprising the 
steps of: 

measuring the performance of the user interaction 
30 with the user interface; 

adjusting said parameters of the user interface to 
increase performance of the user interaction; and 
causing an escalation event to occur if the user per- 
formance is below a predetermined level. 

35 

[0010] Also according to the invention a system for 
monitoring and enhancing computer-assisted perform- 
ance with a business terminal the terminal having an in- 
terface and there being a plurality of independent pa- 
40 rameters associated with various aspects of the inter- 
face; 

means for measuring the performance ol the user 
interaction with the user interface; 
45 means for adjusting the independent parameters of 
the user interface to increase performance of the 
user interaction; and 

means for causing an escalation event to occur if 
the user performance is below a predetermined lev- 
50 el. 

[001 1] It is an important feature of the present inven- 
tion that the business terminal is actually used to per- 
form business transactions while the system is measur- 
es ing and adjusting to increase or enhance the perform- 
ance of the worker assigned to use the terminal or the 
customer using the terminal. 

[001 2] Another important feature of the present inven- 
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tion is that an escalation event such as informing a su- 
pervisor of a problem as it is occurring is automatically 
provided based on measurements of the worker's re- 
sponses at the terminal being used by the worker during 
actual, as opposed to simulated, business transactions. 
Similarly an escalation event such as calling a live teller 
is automatically provided based on measurements of 
the customer's responses at the terminal during actual, 
as opposed to simulated, financial transactions. 
[001 3] Yet another important feature of the present in- 
vention is that the user profile of parameters move with 
the worker as the worker uses different terminals of the 
computer-based business system. Similarly, for ATM 
customers, the user profile of parameters move with the 
customer as the customer uses different ATM terminals 
and performs different types of transactions at the dif- 
ferent ATM terminals. 

[001 4] The invention will now be described by way of 
example only with reference to the accompanying draw- 
ings, in which: 

Fig. 1 is a block diagram of a computer system in- 
cluding retail point-of-sale terminals in accordance 
with a first embodiment of the present invention; 
Fig. 2 is a flowchart of the operation of the present 
invention; and 

Fig. 3 is a block diagram of an ATM network in ac- 
cordance with a second embodiment of the present 
invention. 

[0015] Referring now to the drawings, in which like- 
referenced characters indicate corresponding elements 
throughout the several views, attention is first drawn to 
Fig. 1 which shows a block diagram of a computer- 
based system for use with the present invention. 
[0016] The computer-based system 10 includes a plu- 
rality of terminals 20A through 20N (where N represents 
that any number of terminals is contemplated) net- 
worked together for business purposes such as retail 
point-of-sale terminals, inventory control terminals, 
product ordering terminals or the like. The computer- 
based system 1 0 also preferably includes a main or cen- 
tral processing and storage device 50, Terminals 20A 
through 20N and/or main or central processing and stor- 
age device 50 include the necessary applications, inter- 
faces, and hardware to provide a functioning business 
terminal. Example terminal 20A wilt be used as a repre- 
sentative terminal to describe the aspects of the present 
invention. 

[001 7] Terminal 20A includes a display or monitor 22A 
and an input device 24A, Input device 24A may be a 
keyboard, a digitizer, a scanner, a mouse, a trackball, a 
touch screen or any other known input device. Terminal 
20A also includes a plurality of user interfaces 26A 
which are designed to assist the worker in completing a 
transaction. Various aspects of user interfaces 26A will 
be discussed below. 

[0018] Terminal 20A may also include a key mecha- 



nism 28A, a biometer 30A and a biometer receiver 32A. 
The key mechanism 28A may insure that only author- 
ized workers can operate the terminal. This key may 
open up the cash dispenser, power-up the unit and allow 

5 general access to the computer system. This key or a 
user password may be required to enter the system and 
to access the worker's user profile. The password may 
identify who the worker is and present the user interfac- 
es which the worker is familiar and most productive with 

10 and determines the worker's level of competence. 
[001 9] The biometer 30A can be any standard monitor 
and is preferably used for measuring the worker's pulse 
rate and temperature. The biometer 30 A may be con- 
veniently attached to the worker's wrist as a band or may 

15 be clipped or otherwise attached to the worker in a man- 
ner which enables the biometer to measure the worker's 
responses. If embodied as a non-intrusive appliance 
(such as a lapel pin or wrist band), the biometer 30A 
need not be connected by wires to the terminal 20A. The 

20 biometer 30A can include a transmitter which commu- 
nicates with a biometer receiver 32A. Information can 
be transmitted by cellular, wave communications, or oth- 
er wireless technology. Using wireless communications, 
the worker can move from terminal to terminal and as 

2S the worker approaches a new terminal, the worker's bi- 
ometer transmits information to and receives informa- 
tion from the system. This transfer of information allows 
for fast and secured access to a terminal with the per- 
sonalized interface and performance based system fol- 

30 lowing the worker. Thus, the biometer 30A becomes a 
personal communicator. 

[0020] Examples of standard monitors include biom- 
eters commonly found on equipment in health clubs to 
monitor heartrate (pulse) and other body responses. Ad- 

35 ditionally, measures of temperature are marketed as 
strips that can be placed on one's forehead to determine 
body temperature. Additionally, portable medical facili- 
ties typically include relatively compact biometers, how- 
ever for the present invention, iris probably not neces- 

40 sary to have a medical grade biometer. 

[0021] In the retail environment, for example, user in- 
terfaces 26A include terminal screens for inputting items 
and providing the corresponding price for an item as well 
as calculating the tax and providing a total amount for 

45 the customer to pay. User interfaces 26 A may also in- 
clude screens for assisting in processing returns, in 
processing price corrections, in checking inventories of 
a particular item in that store or in associated stores, 
and any other transactions typically occurring in the re- 

so tail environment, (A screen is intended to indicate the 
layout of items presented on the terminal display 22A. 
This may be determined by standard or customized pro- 
gramming and preferably uses the parameters of the us- 
er profile in the programming to provide further custom- 

55 ization.) 

[0022] User interfaces 26A (and the programming to 
produce them) use a plurality of parameters which de- 
termine how the information is displayed, how much in- 
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formation is displayed, how long (in time) information is 
displayed, etc. User interfaces 26A are intended to in- 
clude multi-sensory indicators such as beeps, bells, 
voice and voice recognition, or other appropriate sounds 
along with the visual screens. 

[0023] Referring to Figure 2, a flowchart ol the oper- 
ation of the present invention is provided. First, in step 
60, a user interface for the business terminal is provided. 
The user interface is preferably configured using param- 
eters stored in a user profile file. Then, in step 62, the 
system measures the performance of the user interac- 
tion with the user interface. In step 64, the system ad- 
justs the parameters of the user interface to increase 
performance of the user interface. The adjusted param- 
eters are preferably stored in the user profile file. In step 
66, if user performance is below a predetermined level, 
then the system causes an escalation event to occur 
and provides varying levels of assistance. As the flow- 
chart in Figure 2 indicates, after adjusting the parame- 
ters or causing an escalation event, the system contin- 
ues to measure the performance of the user interaction 
in step 62 and continues on to steps 64 and 66 as ap- 
propriate. Finally, in step 68, the user completes the ac- 
tual business transaction. 

[0024] As an example, if a relatively long informational 
message is displayed requiring several seconds for the 
user to read, and the user routinely starts inputting the 
next information before the long informational message 
could be read, then the system adjusts and provides ei- 
ther no or a brief reminder message (as it is obvious this 
user does not require the contents of the long informa- 
tional message). The system then tracks (preferably 
through programming) to insure that performance has 
indeed improved. If the system measurements indicate 
that performance has decreased, such as if the worker 
inputs the wrong information since the informational 
message is brief or non-existent, then the interface pa- 
rameters will again be adjusted. The interface may 
change radically, very slightly, or hardly noticeably or 
any increment in between. If a radical change is re- 
quired, the interface may completely change to include 
a completely new interface that includes graphics, video 
clip lead through, simulation, etc. 
[0025] Measurements for the present system can in- 
clude how long it takes the worker to input the desired 
information, if wrong keys are pressed before the correct 
key is pressed, etc. which can be determined through 
standard programming. Other measurements are taken 
through the biometer 30A. The biometer preferably in- 
cludes a biometer communication receiver 32 A which 
monitors the worker's physical responses so that the us- 
er interfaces can be updated to help increase the work- 
er's proficiency. The biometer receiver feeds the work- 
er's pulse rate and temperature to the computer system. 
The worker's transaction speed, correct operation se- 
quence, combined with the pulse rate and the worker's 
temperature helps the system to continuously monitor 
and improve performance through changes in the user 



interface and/or escalation events. 
[0026] Another example using the present invention 
includes the customizing of a touch screen for right or 
left handed workers, or handicapped workers. The sys- 

s tern, through standard monitoring techniques, deter- 
mines that a worker takes a longer than normal or stand- 
ard time to hit the "total" key after scanning or otherwise 
inputting all the items. The system can redefine the area 
of the screen which indicates the "total" key has been 

10 pressed to an area more comfortable for a left-handed 
or handicapped worker and determine if the perform- 
ance is increased. If the performance is increased, then 
the system will store that information so the worker's us- 
er interface will be configured to provide increased per- 

'5 formance regardless of the actual business terminal 
used by the worker. 

[0027] The main or central processing and storage 
device 50 should be large enough to run the required 
business applications as well as the system of the 

20 present invention so the user performance can be 
measured, user interface parameters adjusted, and 
overall performance tracked while the worker is com- 
pleting actual customer transactions. Use of a central 
server or other central storage device allows the user 

2S profile of the "best" parameters to follow the worker to 
any business terminal the worker is required to use. 
[0028] An escalation event occurs when the perform- 
ance is determined by the monitoring system of the 
present invention to be questionable. For example, if the 

30 worker's pulse rate is rising and the transaction through- 
put is dropping (or dropped), the first level of escalation 
can be non-intrusive to the worker and can change the 
worker's terminal interface and/or otherwise present the 
information to the worker in a format intended to en- 

35 hance performance. 

[0029] If the first level of escalation is not effective, 
then the second level of escalation can provide on- 
screen training or performance support guiding or hand 
holding the worker through the steps. At the same time 

40 that the onscreen guidance is provided, a signal can be 
sent to the supervisor's beeper or personal communica- 
tor monitor to indicate that the second level of escalation 
has been reached. A message can flash on the super- 
visor's monitor or beeper indicating the "who, what, 

45 where, when and why 1 of the situation at the second lev- 
el of escalation. The supervisor may call the appropriate 
workstation and guide the worker through the situation. 
In this instance, the supervisor may be at a help desk 
monitoring the workstations from many miles away. If 

so the escalation at the second level is not effective, then 
the third level of escalation may include dispatching a 
supervisor to physically go to the associated workstation 
and to assist the worker. 

[0030] The whole system is intended to support con- 
55 tinuous learning, improve productivity, and to reduce 
cost of completing business transactions. The system 
is intended to be personalized to the worker, relatively 
non-intrusive, and intuitive. The applications need not 
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be local but could be located on a computer miles away 
linked through communications. Alternatively, the appli- 
cations could be local to the user terminal with only the 
user profile parameters being transferred over the net- 
work to the different terminals. 
[0031] A second embodiment of the present invention 
is provided for use with the system 1 00 of Figure 3. Sys- 
tem 1 00 includes a central server or other large process- 
ing and storage device 150 which may be located in a 
bank's main office. System 100 also includes a plurality 
of ATMs 120A through 120N (where N represents that 
any number of ATMs is contemplated). ATMs include 
displays 122A through 122N and user input devices 
124A through 124N. User displays 122A through 122N 
may have a plurality of user interfaces 126A which may 
be adjusted in accordance with the present invention. 
The interface can include multimedia and multi-sensory 
interfaces. The system can also include a biometer 
1 30A and a biometer receiver 1 32A, such as described 
above for the first embodiment of the present invention. 
[0032] In operation, a customer initiates a transaction 
such as by inserting a bank card and entering a personal 
identification number. Upon initiation, the ATM user dis- 
play 1 22A presents the information in a manner that the 
customer encountered the last time the customer inter- 
acted with the system, to provide the information and 
timing that is most agreeable to the customer. For cus- 
tomers responding at a fast pace during an initial trans- 
action with an ATM, the system determines that the cus- 
tomer has a high level of competence so fewer detailed 
screens 1 26A are provided. Thus, the customer can rap- 
idly select the required information and complete the 
transaction rapidly. This increase in transaction time re- 
duces the customer's time at the ATM and allows more 
customers to be handled by the machine in an efficient 
manner. 

[0033] However, if a customer has a slower pace of 
response during an initial transaction with the ATM, the 
system determines that the customer has a lower level 
of competence and the user interfaces are presented to 
help bring the customer "up to speed" but while still be- 
ing compatible with the customer's skill. Through sever- 
al interactions, the customer's response time is in- 
creased, allowing more customers to utilize the ATM 
and increase the efficiency of the system. 
[0034] For example, a typical ATM has the following 
sequence of screens: 

Screen 1 requests the user input his PIN. 
Screen 2 inquires 

1 ) withdrawal 

2) check balance 

3) deposit 

4) pay bills 

Screen 3 (if option 1 is selected) 



1) from checking 

2) from savings 

Screen 4 inquires 

5 

1) $20 

2) $50 

3) $100 

4) other amount (enter in multiples of 10) 

10 

[0035] According to the present invention, if the cus- 
tomer typically withdraws money from a checking ac- 
count, Screen 2 could be personalized to provide the 
following options; 
is [0036] Screen 2A inquires 

1) withdraw $XX from checking; (where XX is the 
amount typically withdrawn) 

2) withdraw another amount from checking; (then 
20 customer is prompted to enter that amount) 

3) return to standard menus 

[0037] This personalized menu can increase the cus- 
tomer's performance and enable more customers to ac- 

25 cess a machine while increasing customer satisfaction. 
[003B] As another example, if a user has a slow re- 
sponse time or measurements from the biometer indi- 
cate that the customer is probably confused or intimi- 
dated, the menus may provide more complete descrip- 

30 tions to help the customer make selections and/or may 
suggest a response if the customer typically performs a 
specific transaction. 

[0039] As described above with respect to the first 
embodiment, an escalation event can occur when the 

35 performance of the customer is determined by the mon- 
itoring system of the present invention to be questiona- 
ble. For example, the first level of escalation can be non- 
intrusive to the customer and can change the customer's 
interface and/or otherwise present the information to the 

40 customer in a format intended to enhance performance. 
If the first level of escalation is not effective, then the 
second level of escalation can provide onscreen training 
or "hand-holding" the customer through the steps. At the 
same time that onscreen guidance is provided, a signal 

45 can be sent to an assigned teller to indicate that the sec- 
ond level of escalation has occurred at a specific ma- 
chine. The teller may call the customer at the ATM (if a 
phone is provided as part of the station) and guide the 
customer through the situation. Alternatively, if the ATM 

so has videoconferencing facilities, these may be used to 
enable the teller to instruct the customer. If the escala- 
tion at the second level is not effective, then the third 
level of escalation can include dispatching a teller to 
physically go to the associated ATM (most likely if the 

ss ATM is located in or near a staffed banking facility). 
[0040] Although these examples involve modifica- 
tions to the ATM screen displays, it is envisioned that 
any aspect of a multimedia and multi-sensory interface 
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may be altered where security allows. For example, if 
an ATM has audio capabilities, the system of the present 
invention may adjust to provide audio messages which 
assist the customer to provide the required responses 
in as efficient a manner as is possible. 



Claims 

1. A method for monitoring and enhancing computer- 10 
assisted performance with a business terminal hav- 
ing a user interface with independently adjustable 
parameters, comprising the steps of: 

measuring (62) the performance of the user in- is 

teraction with the user interface; 

adjusting (64) parameters of the user interface 

to increase performance of the user interaction; 

and 

causing (66) an escalation event to occur if the 20 
user performance is below a predetermined 
level. 

2. The method of claim 1 wherein the parameters of 

the user interface are independently adjustable to 25 
conform to a particular user's performance. 

3. The method of claim 1 wherein the parameters of 
the user interface are stored in a user profile file. 

30 

4. The method of claim 1 wherein the user interface is 
multi-sensory. 

5. The method of claim 1 wherein the business termi- 
nal is an automated teller machine. 35 

6. The method of claim 1 wherein the step of causing 
an escalation event to occur if the user performance 
is below a predetermined level includes providing 
varying levels of assistance to the user depending 40 
on a level of the escalation event. 

7. A system for monitoring and enhancing computer- 
assisted performance with a business terminal (20), 

the terminal having an interface and there being a 4 $ 
plurality of independent parameters associated with 
various aspects of the interface; 

means (30) for measuring the performance of 
the user interaction with the user interface; so 
means (50) for adjusting the independent pa- 
rameters of the user interface to increase per- 
formance of the user interaction; and 
means (50) for causing an escalation event to 
occur if the user performance is below a prede- $ s 
termined level. 
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PROVIDE A USER INTERFACE 
FOR THE BUSINESS TERMINAL 



60 



MEASURE THE PERFORMANCE 
OF THE USER INTERACTION 
WITH THE USER INTERFACE 



— 62 



ADJUST PARAMETERS OF THE USER 
INTERFACE TO INCREASE PERFORMANCE 
OF THE USER INTERACTION 



— 64 



IF USER PERFORMANCE IS BELOW A 
PREDETERMINED LEVEL, CAUSE AN 
ESCALATION EVENT TO OCCUR AND PROVIDE 
VARYING LEVELS OF ASSISTANCE TO THE USER 



— 66 



COMPLETE ACTUAL BUSINESS TRANSACTION — 68 
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